A software system for multi-level hierarchic Markov processes
نویسنده
چکیده
A general software system for construction, editing and optimization of Markov decision processes ranging from traditional models and hierarchic Markov processes to multi-level hierarchic processes is presented. A short description of the system is given and the facilities are illustrated through a sow model defined as a 3-level hierarchic Markov process combining decisions on two time scales. Emphasis is put on modeling tricks that may simplify the structure or speed up the calculations which in real world models are of vast dimensions.
منابع مشابه
Computer Demonstration : a General Software System for Dynamic Programming
A general software system for construction, editing and optimization of dynamic programming models ranging from traditional models and hierarchic Markov processes to multi-level hierarchic processes is presented. The software has a dual purpose. Firstly it is supposed to fulfill the need of the apprentice for demonstration of methods and concepts and secondly it is to some extend expected to co...
متن کاملMulti-level hierarchic Markov processes as a framework for herd management support
A general problem in relation to application of Markov decision processes to real world problems is the curse of dimensionality, since the size of the state space grows to prohibitive levels when information on all relevant traits of the system being modeled are included. In herd management, we face a hierarchy of decisions made at different levels with different time horizon, and the decisions...
متن کاملUtilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملMEASURING SOFTWARE PROCESSES PERFORMANCE BASED ON FUZZY MULTI AGENT MEASUREMENTS
The present article discusses and presents a new and comprehensive approachaimed at measuring the maturity and quality of software processes. This method has beendesigned on the basis of the Software Capability Maturity Model (SW-CMM) and theMulti-level Fuzzy Inference Model and is used as a measurement and analysis tool. Among themost important characteristics of this method one can mention si...
متن کاملSimultaneous optimization of management decisions at the operational and tactical level in animal production
In herd management, we face a hierarchy of decisions made at different levels with different time horizon, and the decisions made at different levels are mutually dependent. Furthermore, decisions have to be made without certainty about the future state of the system. If, for instance, a decision has to be made at the tactical level, it is necessary to assume some policy to be followed concerni...
متن کامل